eclab: Add temperature resolution#247
Merged
PeterKraus merged 1 commit intodgbowl:mainfrom Sep 15, 2025
Merged
Conversation
Contributor
|
Yeah, the uncertainties are in the process of an overhaul (#240) for the new major release, as I'm not happy with how they're stored and how inflexible they are at the moment. This 1e-6 value is then the basically the analog to digital conversion? Is it absolute or relative? |
Contributor
Author
|
Yes it's 1e6 is an absolute value in °C which is half the minimum step that can be measured. I'm not sure if it changes with temperature as we only have data at 25°C. The real measurement is a voltage on a thermocouple, so the real error depends on that voltage reading and the voltage curve of the thermocouple, which I don't know. |
eclab: Add temperature resolution
PeterKraus
pushed a commit
that referenced
this pull request
Oct 1, 2025
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Very small change - adds a temperature resolution to avoid a RunTimeError
The resolution is based of quantization error when measuring temperature with a BCS-815, and is far smaller than the statistical noise, which is more like 0.1°C, but I guess depends on the exact set up.
I would also be fine setting it to nan - maybe this should be the default if the unit isn't in the list?